Diffusion in disordered media as a process with memory 
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The problem of a random walk in a disordered media is mapped into a model of a random 
walk with memory. The latter model, as opposed to the former one, does not make reference to a 
particular realization of the disorder. The equivalence of the two models implies that the new model 
retrieves dynamically a realization of disorder; the only one which is consistent with its dynamics. 
In this new approach to the dynamics in disordered media, effects of memory, aging and the peculiar 
localization properties of the random walker, appear quite natural. 
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The dynamics of disordered systems is a very active 
subject of research of statistical physics. In non equi- 
librium systems, such as driven interface growth Q and 
charge density waves disorder leads to very interest- 
ing effects as depinning transitions, creep phenomena and 
self organization. In out of equilibrium systems, like spin 
glasses, aging effects arise which, at least at a mean field 
level, has been related to the lack of time translational 
invariance and the failure of fluctuation dissipation rela- 
tions ||. The main complication brought by the pres- 
ence of disorder is that, in order to compute a physical 
quantity, apart from the "dynamic" average over different 
stochastic time evolutions, quenched dynamics requires 
a second average over the realizations of disorder. This, 
operationally, implies that one has to evolve the system 
in several disorder configurations and at the end aver- 
age the result over the realizations of disorder. On one 
hand, the dynamics explicitely depends on the particular 
realization of the disorder (typically through transition 
rates). On the other, in most systems, one expects the 
physical quantities to be self averaging and therefore to 
depend weakly on the disorder configuration. This sit- 
uation is rather unsatisfactory, in our opinion, because 
only after this second average over disorder it is possi- 
ble to appreciate the general features of the dynamics. 
It has recently been pointed out j| that this problem 
can be overcome in non equilibrium models based on ex- 
treme dynamics, by appealing to an annealed dynamics 
(we shall use this term as opposed to quenched dynamics) 
which does not make reference to a particular realization 
of disorder. The advantage of this point of view is that 
only the average over different stochastic time evolutions 
need to be taken: the effective dynamics is indeed such 
that the averages over disorder are taken "run time" , i.e. 
at each time step, by the process itself. Moreover this 
approach provides also the statistical weight of the his- 
tory of the process, which is hardly available in dynamics 
with disorder. The key point, in the derivation of such 
annealed dynamics, is that the future evolution has to be 



statistically consistent with the past history. The mathe- 
matical translation of this principle relies on the concept 
of conditional probability. The process thus acquire time 
dependences which naturally explain the emergence of 
memory effects in quenched dynamics. It has also been 
shown that, from this point of view, the relation between 
extremal dynamics and self organization are a simple con- 
sequence of a more general relation between dynamical 
processes with memory and self organization S . 

The purpose of this paper is to apply the same con- 
siderations to an equilibrium system. We shall deal with 
the simplest such system, i.e. a one dimensional random 
walk in random environment. For this we will derive the 
exact corresponding annealed dynamics. This dynamics, 
by definition, does not depend on any particular real- 
ization of the disorder. However, as we shall see, the 
process has the same statistical properties. Asymptoti- 
cally, for large times, the process singles out a particular 
realization of the disorder, which is the only one which 
is consistent with the past history of the process. A sim- 
ple generalization of the dynamics with memory we find, 
shows that, interestingly enough, the disordered dynam- 
ics lies on the border line between random dynamics and 
deterministic dynamics. The random walker, in the lat- 
ter case will sooner or later localize on some site. Finally 
we shall generalize our arguments to the problem of a 
random walk with traps and draw some conclusions. 

The random random walk (RRW) on a line is defined 
by assigning at each site i = 0, ±1, ±2, ... a random vari- 
able pi € [0, 1] drawn from a distribution P{p < Pi < 
p + dp} — (fi(p)dp. The evolution of the position xt of the 
RRW is defined by xt+i = xt + 1 with probability p Xt 
and Xt+i — Xt — 1 otherwise. In spite of its simplicity 
this model has been studied by many authors as a toy 
model for localization ||, depinning transitions B and 
aging effects The most striking feature is that the 
diffusion is extremely slow: The typical size visited by 
the walker after a time t is Sx ~ (hit) 2 . Comparing this 
result, originally derived rigorously by Sinai |9|], with the 
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diffusion of a random walk without disorder, Sx ~ ^/t, 
suggests that disorder has really dramatic effects on the 
dynamics. 

In order to introduce our model, let us consider the 
case of a uniform distribution cf>(p)=l. Imagine to ob- 
serve the walker in its motion, without knowing the real- 
ization {pi} of the disorder. The only information avail- 
able is what one sees, namely the number n^t of times 
that the random walker has visited site i and the num- 
ber kij of times in which it has moved from site i to site 
i + 1. As we shall now show, it is possible, using this 
information, to describe a RRW even if the values of pi 
are not known. This is accomplished by observing that 
the probability that the number of right jumps % — *■ % + 1 
is fc, given that site i has been visited n times and the 
transition probability is pi — p, is simply given by the 
binomial distribution 



P(k\n,p)=( , )p k (l~p) 
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where the notation 
the event A, condit 
ing k as the "effect 
statistical relation 
that p < pi < p 
rule of causes (see 
dP(p\n, k) = (n + 
tain an "effective" 



P(A\B) stands for the probability of 
ional to the occurrence of B. Regard- 
of the "cause" p, we can invert this 
to obtain the probability dP(p\n, k) 
+ dp given k and n. Using Bayes 
@ p. 124), it is easy to find that 
l)P(k\n,p)dp. From this we can ob- 
transition probability 
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where the last equality holds for cf>(p) = 1 (see later). The 
content of eq. (|^) is that, among all the processes and all 
the realizations of the disorder, the probability that the 
random walker will jump from site i to site i + 1, given 
that it has made the same jump k times after the n previ- 
ous visits, is p^ k- This is the transition probability which 
is consistent, in a conditional way, to the past history of 
the process. The history of the process is in general en- 
coded in the effective distribution of the variable pi at 
time t, which was named run time statistics in In 
our case the distribution of pt is parametrized by only 
two numbers rii and ki , and therefore a direct expression 
of the effective dynamics in terms of ki and n,; only is 
possible. The structure of the memory can be described 
by placing a Polya urn on each site [|l0| . 

The model defined by eq. (|J) will be hereafter called a 
random walk with memory (RWM). Its evolution is de- 
fined as follows: define on each site % of the lattice two 
integer "dynamical" variables n^t and ki t which count 
the number of visits on site i and the number of jumps 
i — ► i + 1. At time t = 0, n^o = fci.o — and the walker 
is at site i = 0. At time t, if the random walker is at site 
i, then with probability p®. k . it will move to site i + 1 
and fc^t+i = h.t + 1- Otherwise the walker moves to site 
i — 1 and fci.t+i = kij- In either case rii^+i — rii tt + 1 in- 
creases by one. This process, by construction, is expected 



to reproduce the same results of the RRW with a random 
realization of {pi}. In the RWM, the transition proba- 
bilities depend on the dynamical variables {fc^t, «i,t} and 
therefore evolve in time. On the contrary, in the RRW, 
the transition probabilities pi are fixed before the process 
starts. The equivalence of the dynamics of the two walk- 
ers results from the fact that each realization of the RWM 
asymptotically singles out a realization of the disorder, 
in the sense that p„. % — > Pi as t — > oo, where pi is a 
uniform random number in [0, 1]. This has been explic- 
itly checked in numerical simulations, but it can also be 
argued from the distribution dP(pi\n, k)/dp of pi. This is 
indeed sharply peaked around the mean value p° k , with 
a width of order 1/ 1 \pn. The statistics of the asymptotic 
value of p° k as n — > oo can be explicitly shown to be that 
of uniform random variables by analyzing the moments of 
the effective transition probability Pi(rii) — p„. ki - Drop- 
ping the i index for the moment, one observes that at the 
n — 1 st visit p(n — l) 9 , with probability p(n — 1) increases 
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while with probability 1 — p(n — 1) 



(n+l)p(»-l) 
n+2 



Taking the average over real- 
izations, leads to a recursion relation for the moments of 
p(n) which, with a little algebra, can be solved to find 
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Note that Mi(n) = 1/2 for all n. Moreover all central 
moments ([p(n) — (p(n))] q ) with q odd vanish identically. 
For n^> 1, one easily finds M q (n) = (1 + q)^ 1 + 0(n _1 ), 
i.e. the moments of p{n) tend indeed to those of a uniform 
distribution in [0,1]. Therefore, the distribution of the 
transition probabilities, for a RWM in a box of size L 
with periodic boundary conditions, will asymptotically 
tend to a delta function around a random value pi whose 
statistics is uniform in [0, 1]. However, strictly speaking, 
even with periodic boundary conditions, the random walk 
will never reach a stationary state. This is reminiscent 
of systems out of equilibrium. 

Another interesting observation is that one can easily 
calculate the probability of a realization of the process, 
i.e. of a given history {x(t) : r — l,t}. This is indeed 

given simply by P{n it t} = tli[ n i,t + 0- Note tnat 
to obtain such a quantity in the RRW, one needs to eval- 
uate it for a given realization of the disorder and then 
average over all realizations. 

The diffusion law Sx ~ (ln£) 2 can be understood, in 
the context of the RWM, with the following argument. 
First we note that the values of ki and rii on different 
sites are not independent. For example it is easy to 
check that t = J^. rii and Xt = J^ii^^i ~ n i)- ^ n general 
rii = ki-i + rii+i — fej+i. In this relation the fc's are dis- 
tributed uniformly between and the n's. Then, approx- 
imately, this relation has the form n^+i ~ CiUi with Ci 
a random variable. In other words the variable lnn^ will 
have the shape of a random walk over i, which means that 
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typically the maximum value of n, for i £ [0, L(t)] will be 
"-max ~ exp yj L(t). Since this value will also dominate 
the sum J^i m — t, we can conclude that L(t) ~ (lni) 2 . 

One striking feature of the RRW is the lack of time 
translational invariance. It was pointed out || that two 
times correlation functions are not functions of the differ- 
ence of the times, as is normally the case, but also depend 
on the "waiting" time (i.e. the smallest time). This was 
related in ref. S to the aging phenomena observed in spin 
glasses and glasses. The calculation of (A t A t+T ), where 
At is any observable, depends only on processes between 
times t and t + r. If the transition probabilities involved 
in these process are constant in time, time translation in- 
variance follows naturally. The lack of time translational 
invariance is no surprise in the RWM, because the transi- 
tion probabilities explicitly depend on the "waiting" time 
t. This point can be hardly appreciated in the framework 
of the RRW, where the transition probabilities are fixed 
from the beginning. The absence of quenched disorder 
in the RWM evidences the fact that aging effects result 
from local memory effects. These effects, as shown by 
the equivalence of the RRW and RWM, are also present 
in disordered dynamical systems. 

One might wonder what happens if instead of a uni- 
form distribution one considers a general distribution 
4>(p). It is not difficult to show that all the above con- 
siderations hold the same, apart from the specific form 
of the moments and of the distribution of pi (n) . Indeed 
eq. (^) still holds. However when one inverts it to find 
the distribution dP(p\n,k) one has to account for the 
fact that the probability that p < Pi < p + dp is cj>(p)dp 
with 4>{p) ^ 1 in general. In practice eq. (0) is slightly 
modified, but only up to factors of order n . For exam- 
ple, if (f)(p) = T(a + / 9)x a - 1 (l - a;)^- 1 /[T(a)r(/3)], one 
finds p^ k = (k + fl)/(n + a + 0). Our numerical check 
of the diffusion as a function of a for (3—1 confirm the 
depinning transition for a > 2 found by Derrida p2| . 

To address the problem of localization we note that on 
each site the RWM can create a barrier. If the walker 
has failed to pass a site after n visits, its probability to 
overcome it at the next visit is pf l0 = l/(n + 2). Even 
though this probability decreases, it decreases so slowly 
that any barrier will sooner or later be overcame. This 
results from a straightforward application of the Borel 
Cantelli lemma 10 . It is worth to observe that this be- 
havior is the probabilistic counterpart of the "marginal" 
localization properties of the RRW ||. Indeed it is easy 
to show, by the same argument, that if np® — » 0, as 
n — ► oo the RWM would surely localize, sooner or later 
on some site. This marginality seems to be even stronger 
as suggested by the following argument. For any regular 
distribution <p(p), we found np^ — > 1 as n — > oo. Let us 
therefore generalize our model by taking 
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This describes a generalized symmetric (p® 
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1) random walk with memory. Note that np^ — > l+2?ra. 
We expect that, for a < the walker localizes, whereas 
for a > 0, for large times, the dynamics becomes that 
of a random walker without disorder (i.e. pi — 1/2). 
This expectation is based on the fact that the function 
f(x) = Pn >xn seen as a ma P [i- e - x n+i = f(x n )} has 
two stable fixed points (0 and 1) and one unstable fixed 
point (in x = 1/2) in the first case (a < 0) while in 
the second case the stability is reversed (0,1 are unstable 
and 1/2 is stable). Our problem is not a map, but it 
is similar (it has also randomness). However, numerical 
investigation shows that our expectation is correct. For 
a < the walker localizes, whereas for a > all the 
transition probabilities »i — > 1/2 as t — > oo. In other 
words, as shown in fig. |lj, the dynamics recovers different 
distributions of the disorder in the three cases: 



Hp) = i 

MO = *(?-!) 
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for a = 
for a > 
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From this point of view the case a = is very peculiar. 
It is the only case for which the distribution which is re- 
covered by the dynamics is continuous. The case a < 
bears some resemblance with systems, such as the Hop- 
field model |l3j or folding proteins |Q, where the phase 
space has a peculiar organization and the dynamics "lo- 
calizes" on a particular low energy state. 

The above model can be generalized straightforwardly 
to higher dimensions d. This only requires the intro- 
duction of d dynamical variables k\ ■ , j — l,...,d, one 
for each direction on each site. An even simpler gener- 
alization is the case of a d dimensional random walker 
with random traps: Assign a uniform variable pi S [0, 1] 
to each site of the lattice. If the walker is on site i at 
time t, with probability pi it remains on the same site 
at t + 1, and with probability 1 — pi it diffuses to one of 
the neighbor sites. Still we can use p° fc . for the prob- 
ability of jumping out of site i, conditional to nt visits 
and fej previous jumps out of the trap. It is easy to see 
how the diffusion law is modified in this case. Indeed, 
apart from the fact that the walker can spend a time 
fii > 1 over a given site before jumping to the next one, 
the diffusion is the same. This means that Sx 2 ~ N 
where N is the number of sites visited (i.e. the number 
of jumps). This is related to the time t by summing all 
the times spent on different sites: t — n i- This 

sum is dominated by the large rii values. The probabil- 
ity that the walker has been trapped for rii steps on site 
i is (rii + 1) • The probability that it will jump out 
of the trap is p%. — 1/(^^ + 2). Therefore the distri- 
bution of rii is D(n) = \(n + l)(n + 2)] _1 . This means 

that, for N > 1, t = J2iLi n i ~ NhiN, which yields the 
diffusion law t ~ 5x 2 \nSx 2 . We checked the logarithmic 
corrections to the diffusion numerically. In this case, us- 
ing the generalized model of eq. (|4|), it is easy to find 
that D(n) ~ wT 2 ~ 27xa . Therefore for a > 0, the above 
argument yields the standard diffusion Sx 2 ~ t, whereas 
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for a < one finds anomalous diffusion Sx 2 ~ £i+27ra_ 
Also in this case, therefore, disorder dynamics appears 
to be a borderline case. 

In conclusion we have derived and discussed some sim- 
ple models of random walks which reproduce the behav- 
ior of diffusion in disordered media without specifying the 
disorder. We have seen that the dynamics itself retrieves 
a realization of the disorder with the proper statistical 
properties. Our results may well be used to generate 
dynamically a random realization of the disorder in any 
model with quenched variables. It is tempting to con- 
jecture that such an algorithm could provide an alter- 
native to the simulated annealing |15| procedure used to 
find optimal configurations in disordered systems. The 
annealing procedure has indeed the drawback that, once 
the disorder realization is fixed, the starting configuration 
of the dynamical variables may be "far" from a reason- 
ably good optimal state. Using the above results would 
instead produce dynamically a realization of the disor- 
der which is "consistent" with the configuration of the 
dynamical variables. 



(1982) 

[14] P. G. Wolynes, J. N. Onuchic and D. Thirumalai, Science 

267, 1619 (1995) 
[15] S. Kirkpatrick, C. D. Gelatt Jr and M. P. Vecchi, Science 

220, 671 (1983). 



FIG. 1. Probability density <j>(jp). The solid curve centered 
in p = 0.5 is obtained for a = 0.1 and is reminiscent of a ran- 
dom walk. The dotted lines are previous stages of simulation. 
The solid curve with two peaks in p — and p = 1 refers to 
the a = —0.1 case where localization takes place. 
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